Tertiary Storage Support for Large-Scale Multidimensional Array Database Management Systems
نویسنده
چکیده
Many large-scale scientific domains often generate huge amounts (hundreds of terabytes) of multidimensional data. The only practicable way for storing such large volumes of multidimensional data is a tertiary storage system. Unfortunately in commercial multidimensional Database Management Systems (DBMS) the access is optimized for performance with primary and secondary memory. Tertiary storage memory is not or only in an insufficient way supported for storing or retrieval of multidimensional array data. The intention of this paper is, to combine the advantage of both techniques, storing large amounts of data on tertiary storage media and realizing efficient data access for retrieval with the commercial multidimensional array DBMS RasDaMan.
منابع مشابه
Smart Hierarchical Storage Support for Large-Scale Multidimensional Array Database Management Systems
Large-scale scientific experiments or simulation programs often generate large amounts of multidimensional data. Data volume may reach hundreds of terabytes (up to petabytes). In the present and the near future, the only practicable way for storing such large volumes of multidimensional data is tertiary storage systems. But commercial (multidimensional) database systems are optimized for perfor...
متن کاملHierarchical Storage Support and Management for Large-Scale Multidimensional Array Database Management Systems
Large-scale scientific experiments or simulation programs often generate large amounts of multidimensional data. Data volume may reach hundreds of terabytes (up to petabytes). In the present and the near future, the only practicable way for storing such large volumes of multidimensional data are tertiary storage systems. But commercial (multidimensional) database systems are optimized for perfo...
متن کاملHEAVEN: A Hierarchical Storage and Archive Environment for Multidimensional Array Database Management Systems
The intention of this paper is to present HEAVEN, a solution of intelligent management of large-scale datasets held on tertiary storage systems. We introduce the common state of the art technique storage and retrieval of large spatiotemporal array data in the High Performance Computing (HPC) area. An identified major bottleneck today is fast and efficient access to and evaluation of high perfor...
متن کاملParallel Query Support for Multidimensional Data: Intra-object Parallelism
Intra-query parallelism is a well-established mechanism for achieving high performance in (object-) relational database systems. However, the methods have yet not been applied to the upcoming field of multidimensional array databases. Specific properties of multidimensional array data require new parallel algorithms. This paper presents a number of new techniques for parallelizing queries in mu...
متن کاملPhysical Schemas for Large Multidimensional Arrays
We describe physical schemas for storing multidi-mensional arrays on disk. We have developed an i/o library supporting these schemas that provides an abstract interface shielding scientiic application developers from physical storage details. Our library has resulted in simpliied programming and improved i/o performance in the applications we have studied. 1 Motivation Scientiic applications of...
متن کامل